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n 2002, the New York City Department 

of Education (NYCDOE) launched a bold 

set of education reforms designed to 

transform the educational experiences of 
all high school students: They instituted a 
district-wide high school choice process that 
assigned all rising ninth-graders to specific 
high schools; they closed large, low- 
performing high schools; and they created 
over 100 new small schools to serve students 
in the lowest-income areas of the city. Be- 
cause these small schools are located in the 
communities they intended to serve, do not 
screen students based on their prior academ- 
ic achievement, and thus represent a realistic 
small school option for many students who 
previously did not have one, MDRC research- 
ers call these new schools Small Schools of 
Choice (SSCs). 


Since 2010, MDRC has used naturally oc 
curring lotteries within New York City’s high 
school assignment process to rigorously 
study these SSCs and has reported that they 
have large, positive impacts on students’ 
secondary school and college outcomes.' 
Specifically, for the sample of over 21,000 stu- 
dents who entered a lottery for a seat in an 
SSC during the study period, students who 
won a lottery and enrolled in an SSC (target 
SSC enrollees) were 9.5 percentage points 
more likely to graduate from high school than 
those who lost a lottery and did not enroll in 
an SSC (their control group counterparts). 
This effect was experienced by students of 
all backgrounds — low-income students, 
students who performed below grade level in 


eighth grade, English-language learners, and 
students receiving special education services. 
Seven cohorts of rising ninth-graders have 
experienced these effects, even as other 
school options (the schools that make up 
the counterfactual) have improved.’ Prelimi- 
nary evidence suggests that these impacts 
extended at least one year into students’ sub- 
sequent enrollment in postsecondary educa- 
tion. Finally, SSCs generated these effects at 
no additional cost per graduate. 


Recent MDRC research provides suggestive 
evidence that four organizational inputs of 
schools (leadership quality, teacher em- 
powerment, data-driven instruction, and 
teacher-parent communication) and three 
dimensions of students’ school experiences 
(academic rigor, personalized learning, and 
teacher-student respect) produced part of 
SSCs’ positive impacts on student gradua- 
tion rates.4 Furthermore, in interviews with 
SSC administrators and focus groups with 
teachers, administrators and teachers re- 
ported that close personal relationships with 
students were key to the success of SSCs, 
and that without these relationships teachers 
could not effectively promote an academically 
rigorous curriculum.° 


This brief examines whether the positive 
effects of SSCs translate into impacts on 
students’ postsecondary degree attainment 
and performance in the labor market. While 
nonexperimental research suggests that high 
school graduates are employed at higher 
rates and earn more than those who do 


not graduate,° few experimental studies have 
followed students from high school into post- 
secondary education and the labor market, and 
it is unclear how far an effective four-year high 
school intervention can reach. Findings from 
the few studies that have been conducted are 
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effect. For the one cohort of students that 
the research team was able to follow for six 
years, there was a small, positive, but not 
statistically significant, effect on postsecond- 
ary degree attainment; the sample was small 
and further follow-up is needed. 


mixed. Some show that, after students leave 


high school, any effects on postsecondary edu- Even though they were enrolled in post- 


cation quickly begin to fade; others show that af- secondary education at a greater rate, SSC 
ter a reasonable length of time — eight years or enrollees were as likely as their control group 
more — high school interventions can improve counterparts to have been employed. For 
students’ future labor market performance.’ the subsample of students for whom both 

postsecondary enrollment and labor market 
STUDY AND FINDINGS 
Findings in this policy brief bring together a 

uniquely diverse set of data — NYCDOE high 


school enrollment and graduation data, National 


data were available, there was no difference 
between the employment rates and annual 
earnings of SSC enrollees and those of con- 
trol group students. 

Student Clearinghouse data, and New York State 
(NYS) unemployment insurance data — to pro- 


However, when both postsecondary en- 
vide an early look at the SSC sample’s experiences rollment and employment are considered 
in college and work after high school, a pivotal together or jointly, SSC enrollment had a 

positive effect of 4.8 percentage points on 


the number of students participating in a 


transitional period in an adolescent's life. Box 1 
describes how the research team built this diverse 
dataset. An earlier MDRC report on SSCs found 
that their impact on high school graduation trans- 


“productive activity” (enrolled in postsecond- 
ary education, employed, or both). 
lated into a similar size impact on enrollment in 


WHAT ARE SSCs? 
SSCs trace their origins to the 1990s but 


postsecondary school after high school gradu- 
ation.® This brief presents findings from a study 
were created at scale in 2002, when the 
NYCDOE instituted a district-wide high school 
admissions process that emphasized student 


of SSCs’ impact on postsecondary education and 
labor market outcomes that follows four cohorts 
for four years after high school graduation and 
one of these cohorts for six years after gradua- choice and began establishing over 100 new 
tion. In addition, for a subset of students inthese | academically nonselective small public schools 
(SSCs). The NYCDOE created them in partner- 
ship with a consortium of funders, as well as 
with the United Federation of Teachers, 


the Council of School Supervisors and 


four cohorts, it gives a first look at whether SSCs 
had an effect on students’ employment pros- 
pects or outcomes four years after graduating 
from high school, and how much income they 
earned. The study found the following: Administrators, New Visions for Public 
Schools, and a number of other intermediary 
* Through the follow-up period, the origi- organizations. 
nal effect that SSCs had on enrollment in 
postsecondary education decreased but About 94 percent of students attending SSCs 
persisted: After four years, SSC enrollees 
were 4.6 percentage points more likely to be 


enrolled in postsecondary education than 


are black or Hispanic, 84 percent qualify for 
free or reduced-price lunch, and 75 percent 
enter high school performing below grade level 
their control group counterparts. Students in reading or mathematics. At each SSC, the 


of all backgrounds experienced this positive staff was recruited, the premises built, and the 
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Few studies of secondary school have had the opportunity to follow students into postsecondary education 
and the labor market. This project has done so by compiling three different types of data: the New York City 
Department of Education high school records, National Student Clearinghouse postsecondary enrollment 
data, and New York State (NYS) employment and earnings records. This rich dataset allows the research 
team to describe student outcomes and trajectories for the majority of students in a unique way. For stu- 
dents who competed in lotteries for a seat in an SSC in Cohorts 1 through 4, the team knows that 71.7 per- 
cent of SSC enrollees and 62.2 percent of their control group counterparts graduated from high school. Of 
the high school students who graduated, the team has data on every student who attended a postsecondary 
institution registered with the National Student Clearinghouse, and it has the necessary student identifiers to 
match around 60 percent of the lottery sample students to their NYS unemployment insurance records (that 
is, documentation of taxable employment and income). For more details, see Appendix C at www.mdrc.org. 


Though the research team does not have earnings data for the full sample of students, there is evidence show- 
ing that the sample for which earnings data are available (“earnings data sample”) is representative of the 
overall sample of students in Cohorts 1 through 4. First, the demographic characteristics of both samples are 
markedly similar (as shown in Appendix Tables D and E, at www.mdrc.org), and there are no differences for 
either sample between lottery winners and their control group counterparts. For example, 83.9 percent of SSC 
lottery winners in the full sample are eligible for free or reduced-priced lunch, and 84.9 percent of lottery win- 
ners in the earnings data sample are eligible. In addition, 15.0 percent of SSC lottery winners in the full sample 
are overage for the eighth grade, and 13.9 percent of lottery winners in the earnings data sample are overage 
for the eighth grade. Second, the estimated effect on four-year high school graduation rates is strikingly similar 
for both samples — 9.5 percentage points and 8.5 percentage points, respectively. For these reasons, the re- 
search team used these data in this brief to estimate the unbiased impacts of SSCs on students’ labor market 
outcomes and to learn about the possible effects of SSCs on the full sample, though it is important to remem- 
ber that these data are limited. In future work, the research team aims to collect data on the full sample. 


mission developed “from scratch,” as part of a hiring of new teachers and staff, to providing 


competitive application process that solicited students with opportunities to connect their 
proposals from parents, community members, studies with the world of work. 


teachers, and administrators committed to edu- 


cational excellence. Each SSC planning team 
had the authority to choose a school theme and 
a community or business partner. However, 

all teams were required to propose curricula 
and school structures that promoted academic 
rigor, knowledge relevant to the real world, and 
personalized relationships. In addition, each 
SSC planning team was encouraged to partner 
with an outside intermediary organization that 
could provide additional supports. These sup- 
ports ranged from funding, to assisting with the 


Since June 2010, MDRC has used the lottery 
procedure integral to the NYCDOE high school 
admissions process, which determines place- 
ment when a given school has more applicants 
than seats, to create a sample of over 100 SSCs 
and more than 21,000 students. These lotteries 
provide a random assignment-like experimental 
condition that allows researchers to estimate 
the effects of attending an SSC (as opposed 

to other types of New York City public high 
schools).? 


EFFECTS ON 
PERSISTENCE IN 
POSTSECONDARY 
EDUCATION 


As shown in Table 1, SSCs markedly increased 
the percentage of students graduating from 
high school in four years and going on to 
college. Specifically, for students in Cohorts 1 
through 4, SSCs increased the proportion of 
students enrolling in postsecondary educa- 
tion the year after high school graduation by 
7.4 percentage points (to 44.2 percent for 
target SSC enrollees). In each follow-up year, 
the proportion of students who enrolled in 
postsecondary education in both comparison 
groups decreased incrementally. However, 
SSCs continued to have a positive effect on the 
program group’s persistence in postsecondary 
education. By the second year of postsecond- 
ary follow-up, SSCs increased the percentage 
of students who enrolled in postsecondary 
education by 7.0 percentage points (to 35.7 
percent for target SSC enrollees); by the third 
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year of postsecondary education, this effect had 
decreased to 5.0 percentage points (to 30.8 per- 
cent for target SSC enrollees); and by the fourth 
year of postsecondary follow-up, this effect had 
decreased to 4.6 percentage points (to 27.7 per- 
cent for target SSC enrollees). These effects on 
persistence in postsecondary education hold 
true for all student subgroups, including those 
defined by poverty status, race or ethnicity, gen- 
der, and eighth-grade reading proficiency. (See 
Appendix B at www.mdrc.org.) In addition, SSC 
enrollees were just as likely to enroll in competi- 
tive colleges as their control group counterparts. 
(See Appendix A at www.mdrc.org.) 


By the end of the fourth year of follow-up, 

few target SSC enrollees had earned a degree 
or certificate (7.3 percent), and there is not a 
statistically significant difference in degree 
attainment between the target SSC enrollees 
and their control group counterparts. For the 
one cohort of students whose data the research 
team was able to follow for six years, the SSC 


TABLE 1. SSC Effects on Enrollment in Postsecondary Education, Cohorts 1-4 


P-VALUE FOR 
TARGET SSC | CONTROL GROUP ESTIMATED ESTIMATED 
ENROLLEES COUNTERPARTS EFFECT EFFECT 
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<0.001 


<0.001 


POSTSECONDARY DEGREE ATTAINMENT 
AT END OF YEAR 4 


NOTES: Findings in this table are based on data for 21,113 participants. Estimates of the effect of enrolling in an SSC were obtained by comparing mean 
outcomes for winners and losers of students' first SSC lottery while accounting for which lottery participants enrolled in an SSC and which did not, using 
the lottery outcome interacted with a binary lottery indicator as an instrumental variable for SSC enrollment and adjusting estimated standard errors for 
student clustering by the first school they attended. Some findings may not sum exactly due to rounding error. 


<0.001 


A two-tailed t-test was used to assess the statistical significance of each SSC estimated effect with significance levels indicated as follows: ** =1 
percent and * = 5 percent. 


Cohorts 1,2,3,and 4 consist of students in the study who were eighth-graders in the spring of 2005, 2006, 2007, and 2008, respectively. 


*Each year includes students enrolled in a postsecondary institution at any point in that year after four-year high school graduation. 
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effect on postsecondary enrollment persisted 
and there was a small, positive, but not statisti- 
cally significant, effect on degree attainment 
into the sixth year of follow-up. 


EFFECTS ON 
EMPLOYMENT, 
EARNINGS, AND 
PRODUCTIVE ACTIVITY 


As shown in Table 2, for the subsample of 
students for whom both postsecondary enroll- 
ment and labor market data were available, 
SSCs did not have an effect on employment or 
earnings. The table shows the effect of SSCs on 


yearly employment and earnings for Cohorts 1 
through 4 for four follow-up years. After the first 
follow-up year, an average of 60.0 percent of 
target SSC enrollees were employed, compared 
with 58.1 percent of their control group counter- 
parts. This estimated difference of 1.9 percent- 
age points is not statistically significant. In addi- 
tion, target SSC enrollees earned an average of 
$164 less than their control group counterparts, 
but this difference is also not statistically sig- 
nificant. The same pattern of findings persisted 
for all four years of follow-up and is consistent 
across all subgroups of students. (See Appen- 
dixes F and G at www.mdrc.org,) 


TABLE 2. SSC Effects on Student Employment and Earnings, Cohorts 1-4 with Earnings Data 
P-VALUE FOR 


TARGET SSC | CONTROL GROUP ESTIMATED MB) 
OUTCOME IN FOLLOW-UP PERIOD (%) ENROLLEES COUNTERPARTS EFFECT EFFECT 
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NOTES: Findings in this table are based on data for 10,830 participants. See notes to Table 1 for an explanation of how SSC effects were determined. Some 
findings may not sum exactly due to rounding error. 


A two-tailed t-test was used to assess the statistical significance of each SSC estimated effect with significance levels indicated as follows: ** 
and * =5 percent. 


= 1 percent 


Cohorts 1,2,3, and 4 consist of students in the study who were eighth-graders in the spring of 2005, 2006, 2007, and 2008, respectively. 


For the final outcome shown in Table 2, the 
research team used both postsecondary enroll- 
ment records and NYS unemployment insur- 
ance records to measure whether students 
were working, enrolled in postsecondary educa- 
tion, or both after four years. At the end of the 
follow-up period, an average of 78.2 percent of 
target SSC enrollees were employed, enrolled 

in postsecondary education, or both, compared 
with 73.4 percent of their control group coun- 
terparts. This difference is statistically signifi- 
cant at the 0.05 level. 


CONCLUSIONS 

While it is not surprising that the SSC effect 

on postsecondary enrollment decreases as 
students’ distance from high school grows, it 

is encouraging that the effects persist through 
four years. Future work by the research team 
will continue to follow students through six 
years or more after high school graduation, as 
many of the students may enroll in postsecond- 
ary education part time, may begin in remedial 
coursework and therefore need more time to 
attain a degree or certificate, or both. In addi- 
tion, the research team is working to acquire 
more detailed data related to course enrollment 
for students who attend local educational insti- 
tutions. (While data on course credits students 
earn and remedial coursework they take are not 
available from the National Student Clearing- 
house, these data may be available for a subset 
of students from local institutions.) 


Over time, the large, positive effect that SSCs 
have on high school graduation rates may yet 
translate into greater long-term labor market 
success for students, although these effects 
could be delayed in the short term. There are 
several reasons this may be the case — educa- 
tional advantages such as a high school diplo- 
ma and college enrollment take time to emerge 
as labor market differences. Moreover, at the 
four-year follow-up point, a higher proportion of 
SSC sample members are still enrolled in post- 
secondary education, which likely affects cur- 
rent employment. Enrollees in postsecondary 
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education do not have as much time to work 
as their counterparts who are not enrolled, and 
the work enrollees undertake through a work- 
study program or for academic credit are not 
counted in the NYS unemployment insurance 
data. Indeed, the similar employment rates but 
slightly lower earnings among program group 
members suggest that they are working and 
attending college at the same time. 


The studies that have established a link be- 
tween education interventions and later labor 
market success, namely the MDRC study on 
Career Academies and the study on Project 
STAR, followed students for 8 and 10 years after 
high school, respectively.'° For these reasons, 
the research team will continue to try to match 
a greater portion of the sample to labor market 
data and to follow students over time. 


In future work, the research team will also 
examine variations in impacts on student out- 
comes across SSCs to identify potential school 
features that predict sustained positive effects 
on later outcomes. By doing so, the team 
intends to help policymakers and practitioners 
learn how to support students through this 
critical transitional period. For example, schools 
that place a greater emphasis on academic rig- 
or may do a better job of preparing students for 
the demands of postsecondary education and 
thereby produce large impacts on enrollment 
and persistence in postsecondary education, 
while schools that offer internship opportuni- 
ties and focus on success in the world of work 
may produce greater impacts on employment 
and earnings over time. 
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CHANGE SERVICE REQUESTED 


A First Look at the Effects of New York City’s Small Schools of 
Choice on Persistence in Postsecondary Education, Postsecondary 
Degree Attainment, and Labor Market Outcomes 


By Rebecca Unterman and Zeest Haider 


aking advantage of lottery-like features in New York City’s high school admissions process, 
MDRC has previously conducted rigorous research and published reports providing evidence 
that new small public high schools (Small Schools of Choice, or SSCs) are narrowing the edu- 
cational attainment gap and markedly improving high school graduation rates, particularly for disadvan- 
taged students. Findings in this policy brief bring together a uniquely diverse set of data — high school 
enrollment and graduation data from the New York City Department of Education, National Student 
Clearinghouse data, and New York State unemployment insurance data — to inform the field about the 
transition from high school to postsecondary education and the labor market. After following enrollees in 
SSCs for four years after graduation, the research team found that SSCs’ positive effect on enrollment in 
postsecondary education decreased but persisted — SSC enrollees were 4.6 percentage points more likely 
to have been enrolled than their control group counterparts. Students of all backgrounds experienced 

this effect. Despite entering postsecondary education at a greater rate, the subsample of SSC enrollees, 
for whom both postsecondary education enrollment and labor market data were available, were similarly 
employed, and SSCs had a positive effect of 4.8 percentage points on their probability of participating in 
“productive activity” (being enrolled in postsecondary education, employed, or both). 


